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Using Growth for Accountability: 
for Students with Disabilities 




Background 



The academic progress of students 
is an important indicator of educa- 
tional success. For school account- 
ability systems, using a growth 
model to report on a student's aca- 
demic growth can be viewed as an 
addition to or a replacement for a 
status model. Status models com- 
pare the performance of a cohort of 
students in a grade one year with 
the performance of another cohort 
of students in the same grade the 
preceding year. Growth models 
typically track the achievement of 
individual students from year to 
year. 



► General 

Considerations 

There are both strengths and limi- 
tations in each accountability ap- 
proach (see Table 1). Part of the ap- 
peal of status models is that they 
offer a simple, clear way of seeing 
current achievement levels. This is 
useful for reporting on an educa- 
tional system's progress in helping 
students in a given grade achieve 
higher than students in that grade 
did previously. Status models also 
are especially well suited for show- 



ing students' standing relative to 
established knowledge and skills 
targets. Thus, status models fit well 
with contemporary educational 
practices that emphasize content 
and achievement standards. 

A criticism leveled against status 
models that focus on a small num- 
ber of achievement targets is that 
they give an incomplete picture of 
the effects of an educational sys- 
tem on student achievement. For 
example, improvements in student 
achievement might go unnoted if 
the achievement does not cross tar- 
get thresholds. As a consequence, 
educators might concentrate their 
efforts only on student learning 
that is most visible. 

Part of the appeal of growth mod- 
els is that they can be designed 
to show changes in achievement 
that status models might miss. 
Growth reporting that is not tied 
to particular academic targets can 
provide an indication of how much 
achievement changes for students 
regardless of how high or low their 
performance is or how close it is to 
achievement thresholds. 

Growth models also are appealing 



Considerations 



because they fit well with the pop- 
ular view of education as helping 
students progress from one level 
of knowledge and skills to a higher 
level. These models take into ac- 
count students' different starting 
points. Some people believe that 
this is a more accurate and fairer 
way to compare education systems 
that differ in student composition. 

Growth models face several techni- 
cal and conceptual challenges. One 
challenge is that there are a variety 
of approaches and measures that 
may be used to track growth. Each 
involves specific assumptions and 
each has implications for the ways 
in which student performance is 
included (see Table 2). 

A difficult technical challenge for 
some, but not all, growth models is 
that they require vertical scaling of 
tests. Test developers have found 
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Table 1. Strengths and Limitations of Status and Growth Models for Accountability 



Strengths 


Limitations 


Status Models 


• Relatively simple to implement and communicate 

• Well suited to showing an educational system’s progress in 
helping current students achieve higher than previous students 
did 

• Compares performance to a target that reflects content and 
achievement standards 


• Does not recognize improvements in student performance 
unless target is met 

• Potential for educators to focus excessively on student 
learning that is near performance targets 

• Ignoring different initial student achievement levels raises 
concerns about unfair comparisons 


Growth Models 


• Showing improvement is not constrained by how high or low 
student performance is 

• Taking initial levels of achievement into account seems to be a 
fairer basis for comparing educational systems 

• Growth fits the popular understanding of what education should 
accomplish 


• Some growth models are quite complex and not transparent 

• Some growth models require test characteristics that are 
hard to implement 

• Missing data is a challenge in longitudinal data tracking 

• Lower student performance may be hidden or viewed as 
acceptable, thereby promoting low expectations for some 
students 

• Some growth models fit poorly with an emphasis on content 
and achievement standards 



it difficult to create such tests. 
Another technical challenge for 
most growth models is that they 
require longitudinal data systems 
that track individual students 
across years. Associated with this 
technical challenge is the concep- 
tual challenge of what to do with 
missing data for students who 
enter, leave, or are absent. 

A key conceptual challenge for 
growth models is choosing a 
comparison base. For example, if 
a "year's worth of growth" is de- 
fined as the average growth for all 
students each year, by definition 
half of all students will be below 
the year's growth criterion. More 
complex approaches that establish 
different definitions of a year's 
growth for different groups raise 
other concerns. 

Considerations in 
Assessing Students 
with Disabilities 

The many ways of talking about 
growth become more complex 
when considering students with 
disabilities. In special education, 
growth often refers to changes in 



performance on curriculum-based 
or norm-referenced measures de- 
signed to assess basic skills, re- 
gardless of the student's grade 
level. Although important for di- 
agnostic purposes, these measures 
may not be the best for growth 
models. A basic skills focus can 
inaccurately measure the per- 
formance of students who have 
mastered grade level higher-or- 
der skills (such as problem solv- 
ing) without mastering lower level 
skills (such as computation). Sim- 
ilarly, measuring growth toward 
lEP goals is very different from 
growth models used for account- 
ability. Standards-based growth 
models do not measure growth to- 
ward individualized student goals. 

One of the technical challenges of 
growth models for students with 
disabilities is ensuring that their 
assessment results are incorpo- 
rated into the same accountability 
reports as for other students. Most 
growth models do not include 
results from tests with different 
scales. This is important because 
some students with disabilities 
may participate in alternate as- 
sessments based on alternate. 



modified, or grade-level achieve- 
ment standards. Including scores 
from these assessments along with 
scores from general assessments 
may create challenges for some 
growth models that states must 
address. 

For students with disabilities who 
participate in the same assessments 
as other students, including them 
is not a challenge. Although some 
of these students may take the as- 
sessment with accommodations, it 
is generally recognized today that 
the purpose of accommodations is 
to obtain a valid measure of what 
the student knows and is able to 
do, and therefore scores from ac- 
commodated assessments can be 
treated the same as other scores. 

The challenge of missing data has 
potentially more negative implica- 
tions for students with disabilities 
than other students. For example, 
most growth models either exclude 
students with missing scores or 
create estimated scores. Estimates 
of scores may be less reliable if a 
group of students (such as stu- 
dents with disabilities) has more 
missing scores than other groups. 
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Using Growth for Accountability 



The greater mobility and poorer 
attendance of students with dis- 
abilities has been documented, and 
thus are important factors in con- 
sidering growth models that are 
appropriate for all students. 

Other considerations for students 
with disabilities involve concerns 
about the impact that different 
accountability approaches might 
have on educational practices. 
Evidence of low expectations for 
students with disabilities continues 
to emerge today. One result is that 
students with disabilities often are 
denied access to grade-level con- 
tent. When these students do have 
access to standards-based grade- 
level content and are included in 
accountability, their performance 
on grade-level assessments often 
exceeds expectations. 

Growth models can reinforce low 
expectations for students with 
disabilities if the models explicitly 
set different comparison bases for 



some students or if they simply ob- 
scure low levels of performance by 
reporting growth without indicat- 
ing the actual level of achievement. 
Growth models also can be out of 
alignment with a standards-based 
emphasis if they have no tie to spe- 
cific academic content. 




Recommendations 



Students with disabilities have 
benefited from a focus on grade- 
level content, regardless of the as- 
sessment in which they participate. 
The recommendations provided 
here retain a focus on the benefits 
of accountability for students with 
disabilities, while considering po- 
tential positive and negative conse- 
quences of growth approaches for 
accountability. 



► Retain a standards-based ap- 
proach. Standards-based educa- 
tion has a foundation in content 
standards of what students should 
know and be able to do, as well 



as performance standards that 
indicate how well students demon- 
strate their knowledge and skills. 

A focus only on growth can lose 
sight of the content standards and 
establish "growth standards" that 
have no connection to any particu- 
lar content. 

► Maintain grade-level focus. 

Approaches to measuring growth 
can retain their cormection to 
content standards but still fall into 
below grade-level testing (and 
instruction). Below grade-level ap- 
proaches can lower learning expec- 
tations and poorly reflect progress 
in grade-level content. 

► Include all students. Ways to 
include students with disabilities 
who participate in assessments 
other than the general assessment 
need to be identified. Similarly, 

a growth model should treat stu- 
dents the same regardless of where 
they are in the performance con- 
tinuum. Students with disabilities 



Table 2. Description and Implications of Approaches to Growth Models^ 



Difference Gain Scores 

Question Answered: Is the gain for a group higher or lower than average? 

Description: Take the difference between each student’s scores at starting and ending points. For school or district level results, 
aggregate difference scores across students. For performance standards, compare this year’s gain with the average gain needed to 
meet the standard in a specific number of years. 

Residuai Gain Scores 

Question Answered: Flow much growth was produced by a group? 

Description: Subtract scores predicted based on simple linear equations of prior score(s) from actual scores. Individual or group 
gains greater than zero indicate more than average growth. 

Linear Equating 

Question Answered: Did students stay at the same percentile? 

Description: Compare each student’s placement in a distribution based on actual score with placement based on a predicted score. 
Expected growth is staying in the same location in the distribution from year to year. 

Transition Matrix 

Question Answered: Are students in a group making adequate progress across performance levels? 

Description: A matrix of performance levels for Year 1 and Year 2 defines the number/percent of students that moved from year 1 to 
year 2 levels. 

Muiti-Levei 

Question Answered: Flow much of a group’s growth is the result of group-level effects? 

Description: Both student-level growth and group-level growth are estimated. 



‘^The approaches shown here from CCSSO (2008), pages 7-12. 
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Using Growth for Accountability 



excluded from a growth model 
are likely to suffer the negative 
consequences of reduced access to 
standards-based instruction, lim- 
ited focus on grade-level content, 
and lowered expectations. 

► Ensure that all students are 
visible in the results. Growth ap- 
proaches must retain transparency 
for the performance of all student 
groups. Progress of students with 
disabilities must not be masked by 
the performance of other students. 
Similarly, performance of students 
with only one year of data cannot 
be ignored for accountability. 



^^bout NCEO 

The National Center on 
Educational Outcomes (NCEO) 
was established in 1990 to 
provide national leadership in the 
identification of outcomes and 
indicators to monitor educational 
results for all students, including 
students with disabilities. NCEO 
addresses the participation of 
students with disabilities in 
national and state assessments, 
standards-setting efforts, and 
graduation requirements. 



Policymakers and their measure- 
ment, special education, and cur- 
riculum partners should analyze 
proposed options for using growth 
for accountability, against these 
recommendations. Results of this 
analysis should be articulated pub- 
licly and clearly, so that any option 
that is selected can be defended in 
light of these recommendations. If 
this is not done, there is a risk of 
unintended negative consequences 
for students with disabilities. 
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